Markov processes with product-form stationary distribution

نویسندگان

  • Krzysztof Burdzy
  • David White
چکیده

This research has been inspired by several papers on processes with inert drift [5, 6, 4, 3, 1]. The model involves a “particle” X and an “inert drift” L, neither of which is a Markov process by itself, but the vector process (X, L) is Markov. It turns out that for a number of diffusions with inert drift, the stationary measure has the product form; see [1]. The purpose of this note is to characterize processes with product form stationary distributions. This seems to be a difficult task for the family of all Markov processes so we limit ourselves to finite state spaces. These processes are simple on the technical side so we can analyze them in a quite explicit way. In particular, we obtain a number of examples that can generate conjectures for diffusions with inert drift.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Markov network processes with product form stationary distributions

This study concerns the equilibrium behavior of a general class of Markov network processes that includes a variety of queueing networks and networks with interacting components or populations. The focus is on determining when these processes have product form stationary distributions. The approach is to relate the marginal distributions of the process to the stationary distributions of “node t...

متن کامل

A. Economou: a Characterization of Product -form Stationary Distributions

We consider a general model for continuous-time Markov chains representing queueing systems in random environment. First we study the relationship between its equilibrium distribution and the Palm (or embedded) distributions at certain environmental change epochs. The results enable one to obtain the equilibrium distribution of the continuous-time model in terms of the equilibrium distribution ...

متن کامل

Product-Form Poisson-Like Distributions and Complex Balanced Reaction Systems

Stochastic reaction networks are dynamical models of biochemical reaction systems and form a particular class of continuous-time Markov chains on N. Here we provide a fundamental characterisation that connects structural properties of a network to its dynamical features. Specifically, we define the notion of ‘stochastically complex balanced systems’ in terms of the network’s stationary distribu...

متن کامل

Matrices with banded inverses: Inversion algorithms and factorization of Gauss-Markov processes

The paper considers the inversion of full matrices whose inverses are -banded. We derive a nested inversion algorithm for such matrices. Applied to a tridiagonal matrix, the algorithm provides its explicit inverse as an element-wise product (Hadamard product) of three matrices. When related to Gauss–Markov random processes (GMrp), this result provides a closed-form factored expression for the c...

متن کامل

Local Stabilization of Non-Ergodic Jackson Networks with Unreliable Nodes

This thesis contributes to a better understanding of the behavior of queueing networksthat cannot approach a classical equilibrium state.We consider Jackson networks with unreliable nodes which randomly break down andare under repair for a random time. Our networks are described by Markov processesthe states of which incorporate the availability status and the queue-lengths vect...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007